Sonification Mapping Configurations: Pairings of Real-time Exhibits and Sound
نویسندگان
چکیده
Visitors to aquariums typically rely on their vision to interact with live exhibits that convey rich descriptive and aesthetic visual information. However, some visitors may prefer or need to have an alternative interpretation of the exhibitÕs visual scene to improve their experience. Musical sonification has been explored as an interpretive strategy for this purpose and related work provides some guidance for sonification design, yet more empirical work on developing and validating the music-to-visual scene mappings needs to be completed. This paper discusses work to validate mappings that were developed through an investigation of musician performances for two specific live animal exhibits at the Georgia Aquarium. In this proposed study, participants will provide feedback on musical mapping examples which will help inform design of a real-time sonification system for aquarium exhibits. Here, we describe our motivation, methods, and expected contributions.
منابع مشابه
A.i. in Real-time (automated and Interactive) Sonification (of Gesture Data) Generative Real-time Sonification A.i. in Real-time (automated and Interactive) Sonification (of Gesture Data)
Drawing on implementations of A.I. models for real-time music performance that produce an immediate sonification and visualisation display from gestural and audio input, this paper concerns three areas of relevance to a broader array of inter-domain implementation: integration of A.I. modules (Artifical Life, biologically-inspired and Evolutionary processes) in a system for real-time computatio...
متن کاملSoniMime: Movement Sonification for Real-Time Timbre Shaping
This paper describes the design of SoniMime, a system for the sonification of hand movement for real-time timbre shaping. We explore the application of the tristimulus timbre model for the sonification of gestural data, working toward the goals of musical expressivity and physical responsiveness. SoniMime uses two 3-D accelerometers connected to an Atmel microprocessor which outputs OSC control...
متن کاملA Flexible Framework for Real-Time Sonification with Sonart
We describe significant developments towards a real-time implementation of SonArt, the parameter mapping framework first presented in [1] . Enhancements include the incorporation of Open Sound Control (OSC) [2] which facilitates network communications, direct access to a variety of real-time synthesis software platforms, and distributed synthesis. The original goals for opensource, platform ind...
متن کاملBimba: Sensor Embedded Balls for Creative Sound Generation
Bimba is an exploration into designing playful interfaces which use embedded sensors to sonify object interactions. The system wirelessly collects data from sensors integrated into foam balls and generates a sound composition extracting the most relevant features of movement. We have designed and built a collection of sensor units, implemented a protocol to support a wireless real-time data net...
متن کاملMusical Sonification of Avatar Physiologies, Virtual Flight and Gesture
Virtual actors moving through interactive game-space environments create rich streams of data that serve as drivers for real-time musical sonification. The paradigms of avian flight, biologically-inspired kinesthetic motion and manually-controlled avatar skeletal mesh components through inverse kinematics are used in the musical performance work ECHO::Canyon to control real-time synthesis-based...
متن کامل